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Field of the Invention 

This invention pertains to the field of digital imaging, and more 
particularly to the color-correction of images obtained with digital cameras. 
Background of the Invention 



of still photography, as well as in the field of motion imaging as is evidenced by the 
proliferation of digital cameras and video recorders. Digital imaging has the 
advantage over its counterparts, which utilize conventional media such as silver 
*halide film, that the results are instantly available for viewing, editing, printing, and 
other forms of utilization. 



signals produced by the image sensor will be a function of the spectral 
characteristics of the light used to illuminate the scene. For example, if the color 
processing in a camera is designed to give good color reproduction in a daylight 
illumination condition, unacceptable color reproduction may be obtained if the 
camera is used with tungsten, flash, or fluorescent illumination. This is due to the 
fact that the response measured by the color sensors is a function of the spectral 
power distribution of the light source as well as the spectral reflectance of the 
objects in the scene, and the spectral responsivities of the sensors. 



nominally sensitive to the red, green, and blue portions of the visible spectrum. 
The linear color signals produced by the camera will be given by 



Digital cameras are becoming increasingly common both in the field 



A characteristic of color digital imaging devices is that the digital 



Consider a digital camera having color image sensors that are 
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where R, G, and B are the red, green, and blue color values, respectively. 1(1) is 
the spectral power distribution of the illuminant R(X) is the object spectral 
reflectance. Sr(A,), Sg(^)» and Sb(^) are the spectral responsivities of the red, 
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green, and blue sensors, respectively. The constants kR, ko, and Icb are channel 
dependent gain factors. Typically, these gain values are chosen so that equal color 
signal levels (R = G = B) are obtained when a neutral object is photographed. 

Generally, the RGB color signals produced by the color sensors are 
5 not appropriate for display on any given color image display device. Examples of 
typical display devices include video displays, and digital printers. As shown in 
FIG. 1, a color-correction transformation 12 can be used to transform the RGB 
color signals produced by the color image sensors 10 to form device color signals 
appropriate for the intended image display, and tone-scale transformations 14 can 

10 be used to produce the desired tone-scale characteristics between the scene and the 
display. To accomplish this, it is necessary to know how the RGB color signals 
produced by the color sensors correspond to the perceived color values of the 
color stimulus in the scene as perceived by a human observer, and additionally how 
to produce the same perceived color on the display device. CIE tristimulus values 

15 (X, Y, and Z) are typically used to characterize the response of the human visual 
system to a color stimulus 

I(X) R( X) x(X)dX 
I(X)R(A,) ytt,)dX , (2) 
I(A,)R( X)z(X)dX 




20 where x(X) , 7(^) , and z(X) are the CIE color matching functions, and the constants 
kx> ky, and kz are normalization factors. If the sensor spectral responsivities of 
the detectors are linear combinations of the CIE color matching functions 



SR(X) = aRXx(?i)+ aRY?(^)+ aRZz(^) 

S^) = aGXx(A,)+ aGY7(*0+ *GZ?&) , (3) 

SB(^) = aBXx(A,)+ aBY?(A,)+ aBZz(A,) 

it can be seen, by substituting equation (3) into equation (1), and converting to 
matrix notation, that the tristimulus values of a color stimulus the scene can be 
determined from the RGB color values by the relationship 
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where Mc is a camera color-correction matrix given by 



Mc = 
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Typically, the sensor spectral responsivities will not be linear combinations of the 
color-matching functions so that the matrix relationship given in Eq. (4) will not be 
strictly true, but in most cases a camera color-correction matrix can be computed 
using optimization techniques so that Eq. (4) represents a reasonable 
approximation. 

Once the scene tristimulus values are known, the next step is to 
determine the desired tristimulus values to be produced on the image display 
device. Typically, the illuminant for the original scene photographed by the camera 
will be different from the reference illuminant of the image display device. As a 
result, the tristimulus values of a white object in the scene will be different than the 
tristimulus values of an object that appears to be white on the image display device. 
However, a human observer will perceive them both to be white because of the 
chromatic adaptation capabilities of the human visual system. Therefore, in order 
to insure that a white object in the scene will appear to be white on the image 
display device, it is necessary to apply a chromatic adaptation transformation to the 
scene tristimulus values to determine the appropriate image display device 
tristimulus values. One such chromatic adaptation transformation that is frequently 
applied is the well-known Von-Kries transformation. In the case of the Von-Kries 
transformation, as well as many other simple chromatic adaptation transformations, 
the chromatic adaptation transformation can be accomplished using a simple matrix 
multiplication 
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10 



where Xd, Yd, and Zd are the tristimulus values appropriate for the display device, 
and Mc^ is the chromatic adaptation matrix which is a function of the reference 
whites for the scene and the display device. 

To produce the desired color on some display device, it is necessary 
to use a device model to determine what device control signals will produce the 
desired color. A video display is a common output device for a digital image. 
Video displays can typically be modeled quite accurately by a non-linear function 
describing the tone response of the video circuitry, followed by the application of a 
phosphor matrix that is related to the colors of the video phosphors. Typically, the 
non-linearity is approximately of the form 



*255 / 

^255 / 
\255 I 



(7) 



where Rd, Gd, and Bd are the device color signals, yis a contrast parameter, and 
15 Rc, G c , and B c are the linear intensity color signals. A phosphor matrix, m p , is 
used to determine the device tristimulus values from the linear intensity control 
signals: 



20 
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Therefore, to determine the device control signals necessary to produce a desired 
color, it is necessary to invert these operations by first applying the inverse 
phosphor matrix 



25 



G 

B 



= M 



77 -1 



Yd 
Zd 



(9) 



30 



followed by the inverse of the non-linear tone response function. 

To compute the device control signals from the camera color values 
the operations given in Eqs. (4), (6), and (9) should be applied sequentially. These 
equations represent sequential matrix operations that can therefore be combined 
into a single matrix operation 
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Gd = Mp MCAMC 
Bd 



= Mcdo , (10) 



where MCC is a composite color-correction matrix given by 

5 

MCC = Mp 1 MCAMC . (11) 

Due to implementation speed considerations, this composite color-correction 
matrix would typically be applied in the color-correction transformation 12 rather 

10 than the sequence of individual matrices. Note that if the channel dependent gain 
factors are set up so that neutral objects produce equal RGB color values, and if 
the output device has the usual characteristic that equal RGB device control signals 
produce a neutral image, then the composite color-correction matrix will have the 
feature that equal color values must produce equal device control signals. This is 

15 normally accomplished by requiring that the composite color-correction matrix 
have row-sums equal to 1.0. Following the color-correction matrix operation, 
tone-scale transformations 14 which typically approximate the inverse of the device 
non-linearity. 

Usually, the color-correction operation is optimized for a particular 
20 assumed scene illuminant, as well as a particular output device. If the actual scene 
illuminant is different than the assumed scene illuminant, the color-correction 
operation will not produce the desired result This is due to the fact that the 
different scene illuminant will have a different spectral content, and will therefore 
produce different RGB color values than the reference scene illuminant The most 
25 noticeable result will usually be that neutral colors in the scene will not map to 
neutral colors on the display. This can easily be seen by noting that if the color- 
correction operation were set up so that the color-correction operation produces 
equal device control signals given equal RGB color values, then it will produce 
unequal control signals from non-equal RGB color values. As a result, the image 
30 will appear to have a color cast when the image is displayed. For example, if a 
camera is set up to produce equal RGB signals for daylight illumination, and the 
camera is then used to photograph a scene under tungsten illumination, the 
resulting image will generally appear to have a yellowish cast due to the fact that 
the spectral power distribution associated with tungsten illumination has a much 
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lower level of blue content than the spectral power distribution associated with 
daylight 

To account for this illuminant dependence, many systems have 
implemented a form of illuminant dependent gain control like that shown in FIG. 2. 
5 In this case, a digital camera has red, green and blue image sensors 20 to detect 
light imaged from a scene onto the sensors, and produces color signals R, G, and 
B. An illuminant determining process 22 determines the illuminant dependent gain 
factors Gr, Gq, and Gb that are applied to the color signals using multipliers 24 to 
produce white-balanced color signals Rw, Gw> and Bw- Note that if the color 

10 signals are not in a linear space the application of the gain factors will require a 
more complex operation than a simple multiplication. In^such cases, the gain 
factors can be applied using functional operations, or alternatively by applying 
look-up-tables (LUTs). Another approach would involve using linearization 
functions or linearization LUTs to first convert the color signals to linear color 

15 signals where the gain factors could then be applied by a simple multiplication. 

The white-balanced color signals are then color-corrected using a color-correction 
transformation 26 and processed through tone-scale transformations 28 to produce 
device color signals, R<i } Gd, and Ba, appropriate for the intended image display 
device. The illuminant dependent gain factors are generally chosen so that the 

20 white-balanced color signals produced by photographing a neutral patch will be 
approximately equal. 

A number of types of illuminant determining processes have been 
used in the prior art. One such type of illuminant determining process is an optical 
color temperature detector disposed on the front of the camera. Another type of 

25 illuminant determining process includes the step of having a user identify a neutral 
patch in a captured image and computes the gain factors that would be necessary 
to equalize the color signals for that patch. Still another type of illuminant 
determining process includes having a user choose an illuminant type from a list of 
possible illuminant types. The list of possible illuminant types might include classes 

30 of illuminants such as daylight, tungsten, flash, and fluorescent. 

The use of illuminant dependent gain factors will allow for the 
correction of the overall neutral balance of the image, but there will still be residual 
color reproduction errors associated with this simple illuminant correction 
approach. For example, although a gray patch in the image should be reproduced 

35 as gray, a red patch in the image may be reproduced with an incorrect hue angle. 
This is due to the fact that the color-correction operation was designed for the 
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assumed scene illuminant, thus the camera model and the chromatic adaptation 
correction may not be appropriate for the actual scene illuminant In order to fix 
the remaining color reproduction errors, it is not possible to simply adjust the 
channel-independent gain factors. Instead, the color-correction transformation 
5 must by modified as well. 

In U. S. Patent 5,253,047 Machishima has recently disclosed a 
method for using a color temperature detecting circuit to modify the matrix 
coefficients for the primary color separator used to perform a color-correction 
operation for a color video camera. The primary color separator is used to 

10 compute the red, green and blue primary color signals from the 

luminance/chrominance signals generated by the camera detector circuitry. In 
particular, two constants, referred to as a and p, are varied in response to the 
signal from the color temperature detecting circuit. This approach allows for some 
degree of compensation for variations in the scene illuminant, but it has the 

15 disadvantage that it does not permit for optimum correction because it does not 
allow for using all of the degrees -of -freedom available in the primary color 
separator matrix. Further, it has the disadvantage that the color-correction 
operation can not be optimized for each illuminant type so as to minimize average 
color errors. 

20 Summary of the Invention 

It is an object of the present invention to color-correct multi- 
channel color image signals from a digital camera to account for variations in scene 
illuminant including the steps of determining the scene illuminant, and determining 
an optimum color-correction transformation, adapted to process the color image 

25 signals, that minimizes color errors between an original scene and a reproduced 
image responsive to the scene illuminant. 

This object is achieved by a method for color-correcting multi- 
channel color image signals from a digital camera having multi-channel image 
sensors to account for variations in scene illuminant including the steps of: 

30 a) determining the scene illuminant; and 

b) determining an optimum color-correction transformation in 
response to the scene illuminant which transform minimizes color errors between 
an original scene and a reproduced image by adjusting three or more parameters. 
Advantages 

35 The present invention has the advantage that the color-correction 

process for digital camera images can be optimized as a function of the scene 
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illuminant rather than making the compromises associated with optimizing the 
process for a single illuminant. 

It has the additional advantage that the parameters of the color- 
correction process determined for each illuminant produce the minimum average 
5 color errors given the degrees of freedom associated with the color-correction 
transformation. 

Brief Description of the Drawings 

FIG. 1 shows a prior art color-correction process for a digital 

camera; 

10 FIG. 2 shows a prior art color-correction process for a digital 

camera which uses an illuminant detecting process to apply channel-dependent gain 
factors; 

FIG. 3 shows a color-correction process according to the present 
invention which uses an illuminant determining process to determine an illuminant- 
15 dependent color-correction transformation; 

FIG. 4 shows a color-correction process according for a digital 
camera according to present invention which includes separate tone-scale 
transformations; 

FIG. 5 shows example optimum color-correction matrix coefficients 
20 as a function of daylight color temperature determined according to the present 
invention; 

FIG. 6 shows the average color errors as a function of color 
temperature obtained using the present invention, compared to the average color 
errors obtained when a fixed color-correction matrix is used; and 
25 FIG. 7 shows a color-correction process according for a digital 

camera according to the present invention which includes separate neutral-balance 
transformations. 

Detailed Description of the Invention 

Referring now to FIG. 3, a generic system for practicing the present 
30 invention will be described. A digital camera has multi-channel color image 
sensors 30 to detect light imaged from a scene onto the sensors. The digital 
camera may be a digital still camera, or a digital video camera. In many common 
digital cameras there are three types of color sensors having spectral sensitivities 
that are generally red, green, and blue. For purposes of illustration we will 
35 consider a camera having sensors of this type, but it is clear that the method of the 
present invention can easily be extended to cameras having other types of color 
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sensors such as cyan, magenta, and yellow, or cyan, magenta, yellow, and green. 
The multi-channel color image sensors produce multi-channel color signals shown 
in FIG. 3 as R, G, and B. An illuminant determining process 32 determines the 
illuminant incident on the scene. A color-correction transform determining process 
5 34 determines an optimum color-correction transformation 36 responsive to the 
determined illuminant. The optimum color-correction transformation 36 can then 
be used to process the multi-channel color signals to form device coior signals Rd, 
Gd, and Bd. The multi-channel output signals will generally be adapted for display 
on a particular form of output device such as a video display. Alternatively, the 

10 multi-channel output signals may be device-independent color values. In this case, 
the device-independent color values can then be transformed to device-dependent 
color values for one or more output devices using device profiles that transform 
device-independent color values into the appropriate device-dependent color values 
for a particular output device. This last approach is used by systems commonly 

15 known as color-management systems. 

A number of types of illuminant determining processes 32 can be 
used. One such type of illuminant determining process is an optical color 
temperature detector disposed on the front of the camera. Another type of 
illuminant determining process includes the steps of having a user identify a neutral 

20 patch in a captured image, and characterizing the illuminant based on the relative 
color signals for the neutral patch. A variation on this process would include 
having the user photograph a specific neutral target as part of a camera calibration 
procedure that would be performed each time the scene illuminant changes. Still 
another type of illuminant determining process includes having a user choose an 

25 illuminant type from a list of possible illuminant types. The list of possible 

illuminant types might include classes of illuminants such as daylight, tungsten, 
flash, and fluorescent. Another type of illuminant determining process would 
include analyzing the color signals for the captured digital image to estimate the 
illuminant characteristics from the image information. Methods of this type might 

30 include finding specular highlights in the scene, or analyzing highlight to shadow 
transitions in the scene. Yet another type of illuminant determining process 
includes characterizing the illuminant using a color measurement device such as a 
spectroradiometer, or a colorimeter. 

The process for determining the optimum color-correction 

35 transformation 34 includes determining a color-correction transformation that 

m inimizes the color errors between the scene and the reproduced image given the 
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determined scene illuminant. In one embodiment of the present invention, the 
color-correction transformation may be implemented using a color-correction 
matrix as was shown above in Eq. (10), where the matrix coefficients are 
adjustable. In this case, the process of determining the optimum color-correction 
5 transformation involves determining the adjustable matrix coefficient values that 
minimize the color errors between the scene and the reproduced image. 

Generally, the optimization process may involve using a least-squares 
minimization technique to minimize the color errors for a specific set of scene color 
values. The set of scene colors used in the optimization process can include colors 

10 spanning the range of real world colors, as well as colors of particular importance 
such as skin-tones and neutral colors. 

The scene color values for the set of scene colors can be computed 
using well-known procedures given the spectral characteristics of the scene colors, 
and the determined illuminant If the spectral characteristics of the scene illuminant 

15 have not been directly measured, they can be estimated using the information 

provided by the illuminant determining process. For example, if only the estimated 
color temperature of the illuminant has been measured, an appropriate illuminant 
spectrum having the desired color can be assumed. Alternatively, if the illuminant 
has been determined by having the user choose from a set of possible classes of 

20 illuminants, a representative illuminant spectrum for that class of illuminants can be 
assumed. 

The color of the reproduced image associated with a given color- 
correction transformation can either be characterized by reproduced color values 
for a set of scene colors produced using a particular output device, such as a video 
25 display or a printer, or can characterized by device-independent color values 
adapted for conversion to device-dependent color values at a later time. The 
reproduced color values can either be measured from an actual captured image of a 
test target, or they can be determined from a knowledge of the spectral sensitivities 
of the sensors. 

30 The differences between the perceived scene color values and the 

reproduced color values can be used to determine a combined color error. One 
form of combined color error that can be computed for a given color-correction 
transformation is the root-mean-square (RMS) color error. One measure of color 
error that is frequently convenient to compute is the distance between the scene 

35 color and the reproduced color in a device-independent color space such as the 

well-known CIE tristimulus value color space. Other color spaces that can be used 
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would include so-called uniform color spaces such as CIELAB or CIELUV, or 
device-dependent color spaces (such as video RGB code values). Depending on 
the form of the color-correction transformation and the form of the combined color 
error metric, it may be possible to determine the optimum color-correction 
5 transformation parameter values using simple linear least squares techniques, or it 
may be necessary to use non-linear optimization methods. Examples of non-linear 
optimization methods include iterative Simplex optimization procedures, simulated 
annealing techniques, and genetic algorithms. 

The optimum color-correction transformation 36 can take many 

10 forms. For example, it might include a simple matrix operation having adjustable 
matrix coefficients, it might include a series of matrix and look-up table operations 
having a set of adjustable parameters, or it might include an adjustable three- 
dimensional look-up table (3-D LUT). In yet another embodiment, the optimum 
color-correction transformation can be a set of one-dimensional functions applied 

15 to each of the multi-channel color signals. Because of the fact that there are 

typically three color channels, there will usually be a minimum of three parameters 
that can be adjusted during the optimization process. For example, a color- 
correction matrix will have nine adjustable matrix coefficients, and a 3-D LUT will 
have a number of adjustable parameters given by the number of lattice points in the 

20 3-D LUT. 

In one embodiment of the present invention, the color image 
sensors 30, and the illuminant determining process 32 are integral parts of the 
digital camera. The information regarding the illuminant determined from the 
illuminant detector is stored as a part of a digital image data structure used to store 

25 the multi-channel color signals. The digital image data structure is then processed 
at a later time using a digital image processor adapted to receive the digital image 
from the digital camera. The digital image processor might be a computer 
workstation, or a specialized image processing device. The digital image processor 
performs the color-correction transformation determining process 34 and applies 

30 the optimum color-correction transformation 36 to the multi-channel color signals 
to form multi-channel output signals. The information regarding the illuminant that 
is stored as a part of a digital image data structure might be raw signal values 
produced by the illuminant detector, color signals corresponding to a neutral object 
in the scene, an estimated illuminant color temperature, a measured illuminant 

35 spectra, or some other parameters) that characterize the illuminant 
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In another embodiment of the present invention the illuminant 
determining process 32 is also performed in the digital image processor. This step 
might include analyzing the digital image data to estimate the scene illuminant, or 
having a user select a scene illuminant from a set of possible scene illuminants. 
5 In yet another embodiment of the present invention, the optimum 

color-correction transformation determining process 34 is performed and then the 
optimum color-correction transformation 36 are applied to the multi-channel color 
signals to form multi-channel output signals are performed by a digital image 
processing means integrated into the digital camera so that the output of the digital 

10 camera would be the desired multi-channel output signals. 

Those skilled in the art will appreciate that other alternate 
embodiments are also possible. For example, the color-correction transformation 
determining process 34 can be performed in the camera and the resulting optimum 
color-correction transformation can be stored as a part of a digital image data 

15 structure used to store the multi-channel color-signals. The stored optimum color- 
correction transformation would include a set of parameters necessary to describe 
the optimum color-correction transformation. For example, the parameters might 
include a set of color-correction matrix coefficient values, or a set of 3-D LUT 
values. 

20 Frequently, the color-correction transformation may include aspects 

of tone-scale correction, as well as color-correction. For example, the color- 
correction transformation may include a 3-D LUT that represents the combined 
operations of converting from the sensor color values to the primary color values 
for a particular video display and applying a desired tone-scale function. Many 

25 times it may be convenient to include a separate step for explicitly controlling the 
image tone-scale. This is shown in FIG. 4, where multi-channel color signals R, 
G, and B are formed by image sensors 40. An illuminant determining process 42 
determines the illuminant incident on the scene. A color-correction transform 
determining process 44 determines an optimum color-correction transformation 46 

30 responsive to the determined illuminant The optimum color-correction 

transformation 46 is used to process the multi-channel color signals to form color- 
corrected color signals Rc, Go and Be- The color-corrected color signals are then 
processed by tone-scale transformations 48 to form device color signals Ra, G<j, 
and Ba. 

35 For example, consider a digital still camera having red, green, and 

blue sensitive color image sensors to be processed using the configuration shown in 
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FIG. 4. In this example, the optimum color-correction transformation 46 will be a 
3x3 color-correction matrix to transform from the sensor color values to output 
primary color values appropriate for a typical video display. FIGS. 5a-5c show the 
matrix coefficient values associated with an optimum color-correction 
transformation that are determined as a function of the color temperature of a 
blackbody illuminant: 
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10 The optimum matrix coefficient values were determined by cascading the 

blackbody illuminant spectra having the appropriate color temperature with a set of 
scene spectral reflectance functions to form cascaded scene spectra. The cascaded 
scene spectra were then used to determine the camera RGB color signals given the 
camera spectral sensitivities using Eq. (1), and the perceived color values for each 

15 of the patches using Eq. (2). Reproduced color values can then determined by 
applying the optimum color-correction transformation 46 and tone-scale 
transformations 48 to the camera RGB color signals to produce device color 
signals Rd, Gd, and Bd for a CRT display, A model of the color reproduction 
characteristics for a CRT display can then be used to determine the reproduced 

20 color values given the device color values. In this example, a set of patches from a 
MacBeth Color Checker were used as scene colors, and the color errors for each 
patch were determined by the well-known CIELAB AE* color-difference formula: 



AE*i = V(L* si - L*di) 2 + [a* si - a* di ) 2 + (b* si - b* di ) 2 (13) 



where L* s i, a* s i, and b* s i are the CIELAB scene color values for the i** 1 color 
patch, L*di> a*di, and b*di are the CIELAB reproduced color values for the i 1 * 1 
color patch on the output device, and AE*i is the resulting color error for the i th 
patch. A standard Simplex optimization procedure was used to determine the 
30 values of the matrix coefficient values of Eq. (12) for the optimum color-correction 
transformation such that the RMS color error between the scene color values and 
the reproduced color values is minimized. The RMS color error AE*RMS is 
simply given by 
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AE*rmS=J ZAE*i 2 (14) 
Vi = 0 

where N is the number of color patches. 

It can be seen in FIGS. 5a-5c that the optimum matrix coefficients 
5 vary quite substantially across the range of color temperatures investigated, 

particularly for lower color temperatures. The average color errors for the set of 
color patches calculated for the optimum color-correction matrix at each color 
temperature are shown in FIG. 6. For comparison, a curve is also shown for the 
case where the matrix that was optimized for a 5500K color temperature was used 

10 for all color temperatures. It can be seen that the color reproduction errors grow 
rapidly when the matrix is used at a color temperature it was not designed for. The 
color errors obtained when the optimum color-correction matrix is used for each 
color temperature are substantially smaller than those obtained for the 5500K 
color-correction matrix if the color temperature departs significantly from 5500K. 

15 This indicates that substantial improvements in the color reproduction 

characteristics of the digital camera can be obtained by varying the matrix 
coefficients for the color-correction transformation accordingly. 

In the above example, the optimum matrix coefficients were 
computed with the assumption that the camera electronics are adjusted so that 

20 neutral scene colors produce equal RGB color values. This usually implies that 
gain factors must be applied to the color values produced by each of the color 
channels. These gain factors will also typically be a function of the illuminant. The 
application of the gain factors can be included in the optimum color-correction 
transformation 46, or can be treated as a separate operation. FIG. 7 shows an 

25 embodiment of the present invention which includes a separate neutral-balance 
correction step. A digital camera has multi-channel color image sensors 70 to 
detect light imaged from a scene onto the sensors. The multi-channel color image 
sensors produce multi-channel color signals shown in FIG. 7 as R, G, and B. An 
illuminant determining process 72 determines the illuminant incident on the scene. 

30 A neutral-balance transform determining process 74 determines the neutral-balance 
transform 76 necessary to produce neutral-balanced color signals Rw, Gw, and Bw- 
In this example, the neutral balance-transform 76 is shown as a set of simple gain 
factors Gr, Gq, and Gb that are applied to each of the multi-channel color signals. 
Alternatively, the neutral balance-transform can include more complex operations 

35 such as one-dimensional look-up tables (1-D LUTs). A color-correction transform 
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determining process 77 determines an optimum color-correction transformation 78 
responsive to the determined illuminant. The optimum color-correction 
transformation 78 can then be used to process the neutral-balanced color signals to 
form color-corrected color signals Rc, Gc, and Be- The color-corrected color 
signals are then processed by tone-scale transformations 79 to produce device 
color signals Rd, Gd, and Ba. 

The invention has been described with reference to a preferred 
embodiment However, it will be appreciated that variations and modifications can 
be effected by a person of ordinary skill in the art without departing from the scope 
of the invention. 
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Parts List 

1 0 color image sensors 

1 2 color-correction transformation 

14 tone-scale transformations 

20 image sensors 

22 illuminant determining process 

24 multipliers 

26 color-correction transformation 

28 tone-scale transformations 

30 color image sensors 

32 illuminant determining process 

34 color-correction transform determining process 

36 optimum color-correction transformation 

40 color image sensors 

42 illuminant determining process 

44 color-correction transform determining process 

46 optimum color-correction transformation 

48 tone-scale transformations 

70 color image sensors 

72 illuminant determining process 

74 neutral-balance transform determining process 

76 neutral-balance transform 

77 color-correction transform determining process 

78 optimum color-correction transformation 

79 tone-scale transformations 



